Folding Mirror 



6A 



-10 



299 



7A 



■ 8 (Optical Bench) 



FIG. 1B1 




Magnified Field of View of CCD 
sensor element on object 



Width of projected Planar 
Laser Illumination Beam 
on object 



FIG. 1B3 




BENCH 



FIG. 1G2 



MAY 0 4 2DC4 £ 




FIG. 



1G5 




FIG. 1G6 




33B 



FIG. 1G7 




L BRACKET 




14 
BLOCK 



16 

CYLINDRICAL 
LENS 



2.000" 



FIG. 1G9 





FIG. 1G12 




R<0.5% (760-800nm) 
over zone 04.3 

50/5x0.063;G1x0.4;C1x1.6 



1 



+0.2 -i— 
0.1 0 x45°f 



K5x0.015 



R<1% (760-800nm) , 
over zone 04.8 
5C/5xO.063;G1xO.4;C1x1 .6 



6.5mm 



r (1.41) 

r 2.5+0.1 




FIG. 1G13 



Teatzone 04.3 




FIG. 1G14 




8 

C 



8 



CO 


CO 

» 


(/) 




b 


b 


ng 


ng 


(i.e. Worki 
System) 


(i.e. Worki 
System) 


Object 
-Based 


Object 
-Based 


Farthest 
In PLUM- 


Farthest 
In PLUM 




3 

5 




CD 

5 




FIG. 1G16B 



2DW * 

1 . 




FIG. 1G17A 




VLD PCX PCX 
13 (730) (731) 

FIG. 1G17B 



731 B 



z 

i 



PCX 
(730) 



FIG. 1G17C 



PCV 
(731) 



z 

A 



VLD 
(13) 



n 



VLD 
(13) 



FIG. 1G17D 



FIG. 1G17E 



FIG. 1G17F 




CD 
X 

Q 
O 
O 



o 

c 
o 
E 

"O 




CO 

c 
o 

s 

E 

3 

0) 
(0 

< 



J2 

0) 

s 

co 

c 
co 

tr 

CD 

E 

CO 

2> 

CD 
C/) 

ts 

CD 

O 



O *~ 
O || 



o 

CD 

£ $ 

E *ci 
go 

jo a 



76 S> 



CD 

J3 ' a a 
O O co 



t- cm co 



■a 

CD 

u_ 

CO 

or 
w 

<D 5 
a a> 

■S 1 
si 

.!= TO 

II 

8 

LU 



<D o 

8£ to 
CD O 

LL ^ 0)2^ 

^u-c 2 E 



c 

CD 




CD 

J "8 



CD 



CD 



-a » 
£ a> 

1 = 

to ^ 
co 

>>CD 

> c 

II 

o 



CD 

c 
c 

s 

CO 

"O 
CD 
if) 
CD 

00 
i 

Q 
O 
O 



CD 




Q TO 
"-4— » r= 
CO o 

c w 

1? 

u. cn 00 ii 

CD 



CO 

E 




g 

to 
c 

E 

0) 

o 

S 
i— 

o 



< 

CM 



j5 □ 0) t 
CL EE 00 _l 



THE FIRST QENERAUZEP SPEQKLg-NOISE; PATTERN REDUCTION) 
METHOD OF THE PRESENT INVENTION 



Prior to illumination of the target with the planar laser 
illumination beam (PLIB), modulate the spatial phase of the 
transmitted PLIB along the planar extent thereof according to 
a spatial phase modulation function (SPMF) so as to produce 
numerous substantially different time-varying speckle-noise 
patterns at the image detection array of the IFD Subsystem 
during the photo-integration time period thereof. 



Temporally average the numerous substantially different 
time-varying speckle-noise patterns produced at the image 
detection array in the IFD Subsystem during the photo- 
integration time period thereof, so as to thereby reduce the 
power of the speckle-noise pattern observed at the image 
detection array. 
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THE SECOND GENERALIZED SPECKLE-NOISE PATTERN REDUCTION 
METHOD OF THE PRESENT INVENTION 



Prior to illumination of the target with the planar laser 
illumination beam (PLIB), modulate the temporal intensity of 
the transmitted PLIB along the planar extent thereof 
according to a temporal intensity modulation function (TIMF) 
so as to produce numerous substantially different time- 
varying speckle-noise patterns at the image detection array 
of the IFD Subsystem during the photo-integration time 
period thereof. 



v 



Temporally average the numerous substantially different 
time-varying speckle-noise patterns produced at the image 
detection array in the IFD Subsystem during the photo- 
integration time period thereof, so as to thereby reduce the 
power of the speckle-noise pattern observed at the image 
detection array. 
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THE THIRD GENERALIZED SPECKLE-NOISE PATTERN REDUCTION 



METHOD OF THE PRESENT INVENTION 



Prior to illumination of the target with the planar laser 
illumination beam (PLIB), modulate the temporal phase of the 
transmitted PLIB according to a temporal phase modulation 
function (TPMF) so as to produce numerous substantially 
different time-varying speckle-noise patterns at the image 
detection array of the IFD Subsystem during the photo- 
integration time period thereof. 



£ 

Temporally average the numerous substantially different 
time-varying speckle-noise patterns produced at the image 
detection array in the IFD Subsystem during the photo- 
integration time period thereof, so as to thereby reduce the 
power of the speckle-noise pattern observed at the image 
detection array. 
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THE FOURTH GENERALIZED SPECKLE-NOISE PATTERN REDUCTION 



METHOD OF THE PRESENT INVENTION 



Prior to illumination of the target with the planar laser 
illumination beam (PLIB), modulate the temporal frequency of 
the transmitted PLIB along the planar extent thereof 
according to a temporal intensity modulation function (TIMF) 
so as to produce numerous substantially different time- 
varying speckle-noise patterns at the image detection array 
of the IFD Subsystem during the photo-integration time 
period thereof. 



Temporally average the numerous substantially different 
time-varying speckle-noise patterns produced at the image 
detection array in the IFD Subsystem during the photo- 
integration time period thereof, so as to thereby reduce the 
power of the speckle-noise pattern observed at the image 
detection array. 
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THE FIFTH GENERALIZED SPECKLE-NOISE PATTERN REDUCTION 



METHOD OF THE PRESENT INVENTION 



Prior to illumination of the target with the planar laser 
illumination beam (PLIB), modulate the spatial intensity of the 
transmitted PLIB along the planar extent thereof according to 
a spatial intensity modulation function (SIMF) so as to 
produce numerous substantially different time-varying 
speckle-noise patterns at the image detection array of the 
IFD Subsystem during the photo-integration time period 
thereof. 



Temporally average the numerous substantially different 
time-varying speckle-noise patterns produced at the image 
detection array in the IFD Subsystem during the photo- 
integration time period thereof, so as to thereby reduce the 
power of the speckle-noise pattern observed at the image 
detection array. 
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THE SIXTH GENERALIZED SPECKLE-NOISE PATTERN REDUCTION 



METHOD OF THE PRESENT INVENTION 



After illumination of the target with the planar laser 
illumination beam (PLIB), modulate the spatial intensity of the 
reflected/scattered (i.e. received) PLIB along the planar 
extent thereof according to a spatial intensity modulation 
function (SIMF) so as to produce numerous substantially 
different time-varying speckle-noise patterns at the image 
detection array of the IFD Subsystem during the photo- 
integration time period thereof. 



Temporally average the many substantially different time- 
varying speckle-noise patterns produced at the image 
detection array in the IFD Subsystem during the photo- 
integration time period thereof, so as to thereby reduce the 
speckle-noise pattern observed at the image detection array. 
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THE SEVENTH GENERALIZED SPECKLE-NOISE PATTERN REDUCTION 



METHOD OF THE PRESENT INVENTION 



After illumination of the target with the planar laser 
illumination beam (PLIB), modulate the temporal intensity of 
the reflected/scattered (i.e. received) PLIB along the planar 
extent thereof according to a temporal intensity modulation 
function (TIMF) so as to produce many substantially different 
time-varying speckle-noise patterns at the image detection 
array of the IFD Subsystem during the photo-integration time 
period thereof. 



Temporally average the many substantially different time- 
varying speckle-noise patterns produced at the image 
detection array in the IFD Subsystem during the photo- 
integration time period thereof, so as to thereby reduce the 
speckle-noise pattern observed at the image detection array. 
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THE EIGHT GENERALIZED SPECKLE-NOISE PATTERN REDUCTION 
METHOD OF THE PRESENT INVENTION 



Use a PLIIM-BASED Imager to produce a series of consecutively 
captured digital images of an object over a series of photo-integration 
time periods of the PLIIM-Based Imager, wherein each digital image of 

the object includes a substantially different speckle noise pattern 
produced by natural oscillatory micro-motion and/or forced oscillatory 
micro-movementof the Imager relative to the object during operation of 

the PLIIM-Based Imager. 



1 


r 


Store the series of consecutively captured digital images of the object in 
buffer memory within the PLIIM-Based Imager. 




t 



Add relatively small (e.g. 3x3) windowed image processing filters to the 

additively combine and average the pixel data in the series of 
consecutively captured digital images so as to produce a reconstructed 
digital image having a speckle noise pattern with reduced RMS power. 
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THE NINTH GENERALIZED METHOD OF REDUCING SPECKLE PATTERN 
NOISE IN PLIIM-BASED IMAGING SYSTEMS 



During each photo-integration time period of a PLIIM-Based 
Imager, produce numerous substantially different spatially-varying 
speckle noise pattern elements (i.e. speckle noise pattern elements 
at different points) on each image detection element in the image 
detection array of the PLIIM-Based Imager. 



Spatially (and temporally) average said spatially-varying speckle- 
noise pattern elements over the spatial area of each image 
detection element, thereby reducing the RMS power of speckle- 
pattern noise observed in said PLIM-Based Imager. 



B 



FIG. 11241 



03 



860 



Maximum 
Working 
Distance 



866 




FOV Of a 
Magnified 
Camera 
Detector 
Element 



Lateral And 
Transverse 
Micro-oscillation 
Of PLIB 



FIG. 1I25A1 




FIG. 1I25A2 



862 

865B- 
878- 
879- 

877- 
876 



864 



863 



Maximum 

Working 

Distance 



861 



.865A 
.878 



875 



'879 ^876 
.877 



881- 



FOVOf a 

Magnified 

Camera 

Detector 

Element 



861 



863 



z 



FIG. 1I25B1 



879 



-■ ■■HHf- 



862 




865B 



877 



FOV 



r 

PLIB 
(881) 



FIG. 1I25B2 



MAY 0 < 20C4 f 



863 



862 



865B 




Maximum 
Working 
Distance 



FOV Of a 
Magnified 
Camera 
Detector 
Element 



* Lateral And 
Transverse 
Micro-oscillation 
Of PLIB 



FIG. 1I25C1 



885 



863 




862 



890 



FOV 



T 



PLIB 



865B 



FIG. 1I25C2 





FIG. 1I25D2 



4 20K 



CO 



Maximum 
Working 
Distance 



906 




FOV Of a 
Magnified 
Camera 
Detector 
Element 



Lateral And 
Transverse 
Micro-oscillation 
Of PLIB 

905 s 



861 



863 



T 



FIG. 1I25E1 



862 



if 



865B 




FIG. 1I25E2 




Lateral And 
Transverse 
Micro-oscillation 
Of PLIB 



915 



FIG. 1I25F1 




861 



918 917 920 



916 

1 



863 



T 




919 



862 



865B 



921 



FOV 

7" 

PLIB 
(922) 



FIG. 1I25F2 



MAY 0 4 m 3? 



863 ^861 




Maximum 
Working 
Distance 



FOV Of a 
Magnified 
Camera 
Detector 
Element 



* Lateral And 
Transverse 
Micro-oscillation 
Of PLIB 



FIG. 1I25G1 




FIG. 1I25G2 



935 



861 864 8 ? 3 



937 



Maximum 
Working 
Distance 



865A' 
937 




FOV Of a 
Magnified 
Camera 
Detector 
Element 



* Lateral And 
Transverse 
Micro-oscillation 
Of PLIB 



935 

\ 



861 



z 



863 



862 



FIG. 1I25H1 



936 







i i 0 i , 




u- - 









865B' 937 



938 r 

\ 939 



940 



FOV 



T 



PLIB 



FIG. 1I25H2 



MAY 0 4 2DC4 5? 




Maximum F OV ° f A Magnified 

Working Distance Camera Detector Element 




FIG. 112512 



FIG. 112513 



2DC4 i 





FIG. 1I25J1 




FIG. 1I25J2 



20C4 



864 



863 



Ethalon 
967 



966 




Hybrid Technique: 

• Temporal Intensity Modulation 

• Spatial Phase Modulation 



Maximum 
Working 
Distance 



FOV Of a 
Magnified 
Camera 
Detector 
Element 



Transverse 
Micro-oscillation 
Of PLIB 



FIG. 1I25K1 




FIG. 1I25K2 



MAY 0 4 m t 



864 8 ?3 



Maximum 
Working 
Distance 



Hybrid Technique: 

• Temporal Frequency Modulation 

• Spatial Phase Modulation 



* Transverse 
Micro-oscillation 
Of PLIB 



FIG. 1I25L1 



865A" 




FOVOf a 
Magnified 
Camera 
Detector 
Element 




979 ^ FOV ^/ 9 81 



T 



PLIB 



862 



8656 



FIG. 1I25L2 



4 2CC4 



861 864 



863 



Maximum 
Working 
Distance 



Hybrid Technique: 

• Temporal Frequency Modulation 

• Spatial Phase Modulation 



Transverse 
Micro-oscillation 
Of PLIB 



FIG. 1I25M1 



865A 




985 



FOV Of a 
Magnified 
Camera 
Detector 
Element 

(Frequency Hopping) 



985 



863 



861 



988 
986 




862 



1 



987 / F [ C) V/ 989 



T 



PLIB 



865B 



FIG. 1I25M2 



2GC4 r 



861 864 




* Hybrid: 

* Spatial Intensity Modulation 

* Spatial Phase Modulation 

* Lateral And Transverse 
Micro-oscillation 

Of PLIB 



Maximum 

Working 

Distance 



FOV Of a 
Magnified 
Camera 
Detector 
Element 



FIG. 1I25N1 



995 




862 865B 



FIG. 1I25N2 




FIG. 1H2 



-£> 0.088 

0087 

g 0.086 

M 0.085 

q 0.084 

g> 0.083 

g 0.082 

— 0.081 



Image Distances vs. Object Distance 



12 3 4 
Object Distance (m) 



Series 1 



Focus 



7a 



Ob 



ect 



FIG. 1H3 



Stationary 
L 




FIG. 1H4 



Sensor 



3A 



Focus 



Stationary 
L 




Sensor 



■3A 



Object 



Zoom 



FIG. 1H5 



Fixed Focal Length 
Lens Cases 




FIG. 1K2 




FIG. 1L2 



Pixel Power Density vs. Object Distance (General Example) 



0.030 



0.025 _ 



0.020 _ 



0.015 _ 



0.010 _ 



0.006 _ 




0.6 0.7 0.8 0.9 1.0 1.1 1.2 1.3 1.4 1.5 1.6 

Object Distance (m) 



FIG. 1M1 



Near And Far Object Distance Laser Power 
Distibution Data And Curve Fit 




-1 -0.5 0 0.5 1 



Position Along Planar Laser Beam Width (m) 



FIG. 1M2 



Planar Laser Beam Width vs. Object Distance 



t 1 1 1 1 1 I r 




I I I I I I I I I 1 L_ 

0.6 0.7 0.8 0.9 1.0 1.1 1.2 1.3 1.4 1.5 1.6 

Object Distance (rn) 



FIG. 1M3 





FIG. 1M4 



Center Line Power Density vs. Object 
Distance (Far Object Distance Focus) 




0.6 0.7 0.8 0.9 1.0 1.1 1.2 1.3 1.4 1.5 1.6 

Object Distance (m) 



FIG. 1N 



Pixel Power Densities vs. Object Distance 




FIG. 10 



Results Of Summing Contributions 
From All VLDs 




Displacement (m) Contibutions Displacement (m) 



FIG. 1P1 



FIG. 1P2 




299 



3B 



1C 



7B 



Belt Surface 



12 



FIG. 1Q1 



MAY 0 4 m S 

H 



299 




FIG. 1R1 



0< 2DK ? 




FIG. 1S1 




FIG. 1T 




FIG. 1V2 



m 0 * 2BK * 




FIG. 2B1 



O 




MAY 0 4 2X4 * 




FIG. 2D1 



MAY 0 4 2CC4 ? 



si 

o o 
-i O 
o> tn 
c 3 

— o 
& £ 

O) (0 

c c 

— ' a 
86 

0) c 

.* to 
u_ > 




CO 

a 

CM 

d 




MAY 0 4 2CC4 




FIG. 2E1 



MAY 0 4 2CC4 £| 





MAY 0 4 m 



t <>>] 




FIG. 2F1 



Top Conveyor Scanner: 

• Fixed Focal Length Imaging Lens 

• Variable Focal Distance Control 




FIG. 2G 




Host 
System 



FIG. 216 



MAY 0 4 2DC4 * 





FIG. 3B1 



MAY 0 4 2CM 





402 407 

FIG. 3D3 



1109A 1109B 




Sensor Window 



FIG. 3D4 




1105C 1105D 



FIG. 3D5 



2CC4 ¥ 



1107 




FIG. 3D6 




FIG. 3D7 




FIG. 3E1 




FIG. 3E4 




FIG. 3E5 



0 4 2CC4 2 



10.607 



3.500 



Optics Bench 



CCD FOV And VLD 
Beam Limits (Overlaid) 



CCD Folding 
Mirror 




12,10 



FIG. 3E7 



* Variable FOV 




FIG. 3E8 



MAY 0 4 20K 





I 




FIG. 3G1 



MAY 0 4 2GK 



CP 




Variable Focal Length Imaging Lens 
Variable Focal Distance 




FIG. 3H 



2QC4 £ 




FIG. 3J2 



2-D Hold-under Scanner 



FIG. 3J6 




FIG. 4B1 



MAY 0 4 20C4 5? 



Mechanical 
Oscillator (58A) 




FIG. 4C1 




2-D Hold-under Scanner 



FIG. 4D 




FIG. 5B1 




FIG. 5C1 




FIG. 5D 




FIG. 6C1 




FIG. 6C5 




FIG. 6D1 



19.749" 



a. 



501 



500 



Image 
Processing 
Computer 



21 



6A 299 68A 




Camera 
Control 
Computer 



55" [I ~ _ _ 



7 



I I 
I I 



Optics Bench 
(8) 




25 



68B 



FIG. 6D2 



0^ » ti 




FIG. 6D3 



* Variable FOV 




Level 



FIG. 6D5 




FIG. 6E1 



mm 



0 A 2DC4 * 





1 0' (Projected) 



FIG. 6E4 



102 




CCD Image Detector 



FIG. 7A 




FIG. 73 





FIG. 8B 



CD 
CN 



eg 



CO 
CM 



O 
< 

CL 



3 

o 



O w 

*^ > 
O CO 
Q CO 

S3 




Of 
LU 
CO 
3 



o 

CO 



in 

CM 



LU 



O 



LU O y 

±: < > 

2 9 £ 

Q CD 



o 
< 



Li. LU 

-t CO 
CQ 
3 



CD ^ co 



LU 
O 
_ < 

^ 111 



c 
a) 

E 
a) 

LU 

iS 

CD 

Q 

O) 
CN 




u_ 1 -If- J 



0) 

Q_ 

E 
o 
O 

c 

CD 

E 
a> 
o> 

CO 

c 

CD 



O 



CO 



CD 



LU 



3 _ CO 

Dj Q > 

3 Z CO 

a < 2> 

HOco 

!□§ 

^ Q = 
LU ^ CO 

LU ^ uj 
H O 

< a: 

Q CL 



LU 

o 



UJ 



LU 



o 
< 

Q. 



£2 

3 CO 
CO CD 
< 3 
UJ CO 



a. 

Q 



i 



> Q 

co a: 

CD . 

3 CO 

CO 2 

■yf CQ 

3 Q 

< * 

O o) 



LO 
CM 



92 

— CO 
CO 
3 
CO 



/ 



^3 



CD 

QQS? 

o =? 

o 



I — 
CO 



CO 



< z 



CN 



CN 
CO 



!It / 



if ^ 



' 



— CD W LU ?5 

< | UJ ^ D 
Q. = Q Q (/) 



CO 
CO 



/ 



^ UJ m CO I ▼ ▼ 



o 



Q i2 



i2 



2r °> - < 

<0 0> CO 



T- 1 



i e* CO LL CO £ O 



O CL O UJ 



CO 

If 

(V 

CO 

>> 
co 

CO 

O) 
C 

CO 
CO 
CD 

u 
o 



c 

CD 
O) 

C 
CD 

X 

ri> 
_c 

CD 



c 

CD 

E 

LU 

iS 

CD 

Q 




0> 

§ I ^ II 

| E g Q t E 
S ® ~ 2 < 

t! § 5 "g o w 
.92, c SS E .2: .32. J5 

02QW jOQ 



.< c 

CD CO E 

ZOO LU. 



c 

CO 

-tf O) 

E 

UJ x 

(D - 

a 5 

CD 
13 

a 



c 
c 

□ e 

T3 CO 
£ c 
CD CD 
O) -C 
C <■> 
CD 

CO ^ 
CO ^ 
CD 

o 
o 



O 

o 

CO 
CM 



O 
CO 
CM 



z 




\ 


s 


7 


I/O 
Unit 


i 


i * 

m m m 


i 


• • # 





1^ 

CM 



3 
a 

c 
o 

cS 
o 

o § 
.2, c 

_cT CD 

O 2 



^~c7 

CD 

a 



CM 
O 
CO 
CM 



2 CD - 

3 "a Q 
£ O £ 

C CD i- XT 

Q) CQ <D CD 

C . "O "O 

5; 0> CO CO 

lu A a: a: 



CO 



CD 

5 a. 
< c 

.5* _CD 

O UJ 



IS 

CD 

la" 
O 
o> 
ai 



CO 

c 
o 



.co E 

CO CD 
CD 

CD GO 

S 2 £ 8 
Q £ X Z 



o 
"55 

CO 

'co 

CD 

c 

< 




= § 

CD .g 
r- 0> 



CO 

o 



E 
CO 

"8 



C 
CD 

"D 

C 
CD 

- 3 
O) O 
C CS= 

•c? c 
o o 
ro O 

CO 

U CD 

a) ^ 

g is 

og 

.1 'i 



O t/5 
m 3 



w c 



(A 

a> 



o ™ -J C JO c 
^ O 2*-m CD ® r 



,9- co 



CO 



CO 



0)"O 
C CD 

5 1* co jfi 

MM 

CD O 



•s ts R 8 



a) o « a) 



t CO 



.O W . (D 9 

3 ro £. c 



CO 

a> 



8 * SB 1 



CM 



a> 



c 5 r 



St*- §. 



CO 



CO 



CD 
CO 



CD 



•5 TS .2 £ t3 -2 



(0 
CD 



<D 2 



O E c O 5 

co 



° IS S ^ 

^ ^ r r 



8" o E 



£ CD 



CO 
CD 



w ^- © w - m ^ 



■=5 O 



CD 3 



O 



°.ii o f y o 



ro 



</ — 



•2 C o 



8" o E 



cd o 



E £ 

•C CD 
CL Z 



in 
c 

E .2 

"O CO c 
C >* 3 
CO CO IL 



c o 



£ « S 2 1 E 

o s 1 y k ■§ ^ 

$ O ~ -o g- co 

. Ol ^_ CD tz CO >» 

< CO o Q co O CO 



o g o 
«= .2>,£ S E 

<j _Q "^3 03 cd 

cd O S Q- co 
. CL Z. ^ nj > 

co co o 2 o co 



c 

loo |f | 

O 5 -Q 3 CO >s 

SOS 57 S- w 

O CO o < < O o 




CO i5 

c J£ 

.2 z 

co o 
o z: 

s E 

c_ -4— » 

<D GO 
"O 

— CO 

- 3 
O) O) 
c i^r 

15 c 
o o 
2 O 

I- co 

§ ° 

:2 go 

O CD 

§i 

St 

Sg 



CO 

.5 1 

p 

Q. 5 
< 



.2 w 
fn =» a 



o 

w ^ 3 '2 o Si, 
O e c O £ 



■■5 B -2 ^ 



8" o £ 



o ^ 

CO Q) CO 



2 - 



52 



O E c O fi 



CO 



C "FTU- O o CD o 



CM 
i 

m 

o 




(0 

c § 

I i ° I =8 
I J E & § 

Q. 2 CO CO LU 



c 
o 



c o 



O -22 -o Q. co 
. cl^L a> c co >> 

< (/) o Q co O CO 



o g o 

TO CO r^T 

o -Q -5 co 0) 

. Q. J_ 0> CO 

CD CO O 2 O (O 




'O S*-Q 3 CO 

SO£ O- Q-CO 

• CL u_ O CO 

O CO o < < O o 



Specify object detection and tracking capabilities of PLUM- based network , system, 

and/or subsystem. 



± 

Specify object identification capabilities of PLIIM-based network , system, and/or 

subsystems. 

i 

Specify object attribute acquisition capabilities of PLIIM-based network, system, and/ 

or subsystem. 



t 

Determine the configuration of hardware components required to build the configured 
system or network. 



t 

Determine the configuration of software components required to build the configured 

system or network. 



T 

The system configuration manager program accesses the determined software 
components from its Software Library (e.g. maintained on an information server within 
the system engineering department), and compiles these software components with all 
other required software programs, to produce a complete System Software Package 
designed for execution upon a particular operating system supported upon the 
specified hardware configuration. 



4 

The systems configuration manager program automatically generates an easy-to- 
follow set of Installation Instructions for the configured system or network, guiding the 
technician through an easy to follow installation and set-up procedures making sure all 
of the necessary system and subsystem hardware components are properly installed, 
and system and network parameters set up for proper system operation and remote 

servicing. 



Once the hardware components of the system have been properly installed and 
configured, and the set up procedure properly completed, the technician is ready to 
operate and test the system for troubles it may experience, and diagnose the same 

with or without remote service assistance made available through the remote 
monitoring, configuring, and servicing system of the present invention, illustrated in 

Figs. 30A through 30D2 
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FIG. 13B 




FIG. 13C 




PLIIM-BASED PACKAGE IDENTIFICATION AND 
DIMENSIONING (PID) SYSTEM 



LDIP Package 
Dimensioner With 
Integrated Package 
Velocity Detection 



551 



Image Processing Computer 



Auto-Focus/ Auto-Zoom 
Digital Camera 



Camera Control Computer 

Subsystem 
(Figs. 24A, 24B, 25, 26, 27, 
28, 29) 



Package 
Velocity 



Real Time Package Height 
Profiling And Edge- 
Detection Processing 
Module 

(Figs. 21, 22, 23) 



550 
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21 
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FIG. 14 



LDIP REAL-TIME PACKAGE HEIGHT PROFILE AND 
EDGE DETECTION METHOD 



B 



H 



Raw Data Is Received Every 5 ms; Plus Time Stamp 



Convert Raw Data Into Range Profile R «= f(int 
phase), Referenced With Respect To Polar 
Coordinate System Symbolically Embedded In LDIP 
Subsystem 



Use Geometric Transformations 

h(i) = R(i)sin(ang - 90) And 

x(i) = R(i)tan(ang - 90) To Convert Range Profile 

R(i) Into Height H(i) And Position x(i) Data 



Obtain Current Package Height By Finding Prevailing 
Height Using Edge Detection Without Filtering (Fig. 
16) 



I 



Find The Coordinates Of the Left And Right Edges 
Of Package (LPE, RPE) By Searching For The 
Closest Coordinates From The Edges Of The Belt 
(X e . X^) Toward The Center Thereof 



Analyze Intensity Data Values (R(nt)} And Determine 
The X Coordinate Position Range . (In R 
Global) Where The Height Intensity Changes (i) 
Within The Spatial Bounds (X^, Xp^) And (ii) 
Beyond Predetermined Height Intensity Data 
Thresholds 



Create Time-Stamped Data Set {X^, h, X m ,V B , nT} 
By Assembling Package Left Edge Coordinate (LPE), 
Current Package Height (h), Package Right Edge 
Coordinate (RPE), X Coordinate Subrange Where 
Height Values Exhibit Maximum Intensity Changes, 
Package Velocity (V B ), And Time Stamp (nT) 



1 


f 


Send Hextuple Data Set To Camera Control 
Computer 



LDIP Package Dimensioner 
With Integrated Velocity 
Detection 



Real-Time Package 
Height Profiling And 
Edge Detection 
Processing Module 
550 



Belt Velocity (V B ) 



551 



FIG. 15 



LDIP REAL-TIME PACKAGE EDGE DETECTION 



LPE = X[la] 
i = la 




No 



Yes 




Yes 



i++ 



LPE = X[i] 



RPE = X[lb] 
i = lb 




Yes 



No 




RPE = X[i] 



EXIT 



Xa = Location Of Belt Left Edge; Xb = Location Of Belt Right Edge 
la = Belt Left Edge Pixel; lb = Belt Right Edge Pixel 
LPE = Left package Edge; RPE = Right Package Edge 
HQ = Pixel Height Array; XQ = Pixel Location Array 
win = Package detection Window 



FIG. 16 




FIG. 17 



Information Measured At Scan Angles Before 
Coordinate Transformations 
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FIG. 17A 
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FIG. 17B 



Measured Package Height And Position Values 
After Coordinate Transforms 

H[] 

Input Height After 
Coordinate Transforms 
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FIG. 17C 



CAMERA CONTROL PROCESS CARRIED OUT WITHIN THE CAMERA 
CONTROL SUBSYSTEM OF EACH OBJECT IDENTIFICATION AND 
ATTRIBUTE ACQUISITION SYSTEM OF PRESENT INVENTION 

Start 



1 



a' 


Camera Control Computer receives a time-stamped quintuple Data Set 

(i.e. coordinate of Left Package Edge, coordinate of Right Package 
Edge, height, velocity, and time stamp) from the LDIP Subsystem and 
stores the Data Set in a Package Data Buffer Structure having N=5 
columns and M rows; Camera Control Computer computes optical power 
(milliwatts) which each PLIA must produce (using method in Figs. 18C), 
and transmits the computed optical power to each PLIA and dependent 

system. 


« — 1 


















r 






EC 


Camera Control Computer analyzes height data in the Package Data 
Buffer and detects the occurrence of detecting discontinuities, and 
based on such detected height discontinuities, determines the 
corresponding coordinate position of the leading package edges by left- 
most and right-most coordinate values associated with the data set at 
this detected height discontinuity. 





Camera Control Computer determines the height of the 
package associated with the leading package edges 
determined at Block B above. 



® 

FIG. 18A-1 



N. 



Camera Control 

Computer 
transforms the 
position of left and 
right package edge 
(LPE, RPE) 
coordinates 
buffered in the 
deepest row of the 

Data Package 
Buffer at which the 
height value was 
determined at Block 
D to a Global 
Coordinate 
Reference System 

symbolically 
embedded in the 

conveyor belt 
structure beneath 
the LDIP 
Subsystem, as 
shown in Fig. 1 7. 



® 



Camera Control 
Computer analyzes 
the height values (i.e. 
coordinates) computed 
over previous raw data 
set processing cycles 

and stored in the 
Package Data Buffer, 
and determines the 
"median" height of 
package, as well as 
the average "slope" of 
the package's laser 
scanned surface. 



K 



Camera Control 

Computer 
analyzes height 

value in the 
Package Data 

Buffer, and 
determines the 
speed of the 
package (V b (t)). 



© © 



FIG. 18A-2 



© 



1 



Camera Control Computer detects the x-coordi nates of the package 
boundaries based on the spatially-transformed coordinate values of 
the left and right package edges (LPE, RPE) buffered in the Package 

Data Buffer. 



i 



Based on x-coordinates of the detected package boundaries (and 
optionally, the subrange of x-coordinates over which maximum range 

"intensity" data variations have been detected at Block F in Fig. 15) 
determined at Block O, the Camera Control Computer determines the 
corresponding pixel indices (i, j) in the Image Buffer which specify the 
image frame (i.e. region of interest) to be cropped from the image(s) 
to be subsequently captured by the IFD Subsystem. 



Camera Control Computer uses the Focus/Zoom Lookup Table in Fig. 
21 to determine the focus and zoom lens group positions based on 
the height of the package determined at Block D. 



i 



Camera Control Computer transmits Lens Group Moves Commands 

to the IFD Subsystem. 



i 



IFD Subsystem uses the Lens Group Movement Commands to move 
the lens groups to their desired positions. 



i 



Camera Control Computer checks resulting positions of moved 

lens groups. 




® 



FIG. 18B-1 




Camera Control Computer uses the computed values of median 
package height, belt speed and the Photo-Integration Time Lookup 
Table in Fig. 23 to determine the photo-integration time parameter 
which will ensure that "square" image pixels are produced in captured 
package images (i.e. pixels having a 1:1 ratio); Camera Control 
Computer also uses (i) computed belt speed/velocity, (ii) the pre- 
specified image resolution (dpi), and (iii) computed "slope" of laser 
scanned surface so as to compute the surface-slope compensated 
Line Rate of the IFD subsystem that helps ensure that captured linear 
images have substantially constant pixel resolution (dpi) independent 
of the angular arrangement of the package surface during surface 
profiling and imaging operations. 



M 



Camera Control Computer generates digital control signals for the 
compute parameters-Photo-lntegration Time Period and 
Compensated Line Rate™ and thereafter transmits these digital control 
signals to the CCD image detection array in the IFD Subsystem. 



Q 



Camera Control Computer uses package time-stamp (nT) and 
package velocity (V ) to determine the "Start Time" of Image Frame 

Capture (STIC) 



Camera Control Computer uses (i) the Start Time of Image Capture 
(STIC) determined at Block Q, to generate a command for starting 
Image Frame Capture, and also uses (ii) the pixel indices (ij) 
determined at Block P to generate commands for cropping the 
corresponding slice of the "region of interest" in the image being 
captured and buffered in the Image Buffer within the IFD Subsystem. 



Camera Control Computer transmits the command generated at Block 

R to the IFD Subsystem. 



FIG. 18B-2 



METHOD OF COMPUTING OPTICAL OUTPUT POWER FROM LASER 
DIODES IN A PLANAR LASER ILUMINATION ARRAY (PLIA) FOR 
CONTROLLING THE CONSTANT WHITE-LEVEL IN IMAGE PIXELS 
CAPTURED BY A PLUM-BASED LINEAR IMAGER 



Compute the Line Rate of a Linear Image Detection Array (dots/ 
sec) based on computed Belt Velocity (inches/sec) and constant 
Image Resolution (dots/inch) desired, using equation: 




Line Rate = (Belt Velocity) x (Image Resolution) 




Compute the Photo-integration Time AT of the Linear Image 
Detection Array based on the computed Line Rate using the 

formula: 



Photo-integration Time Period = 1/Line Rate 




FIG. 18C1 




© 



Compute the Optical Power (milliwatts) of each PLIA based on the computed 
Photo-integration Time Period (AT) using the following formula: 



Optical Power of VLD (milliwatts) = 



constant 



Photo-integration Time Period AT 



FIG. 18C2 



METHOD OF COMPUTING COMPENSATED LINE RATE FOR CORRECTING 
VIEWING-ANGLE DISTORTION OCCURING IN IMAGES OF OBJECT 
SURFACES CAPTURED AS OBJECT SURFACES MOVE PAST A PLIIM- 
BASED LINEAR IMAGER AT NON-ZERO SKEWED ANGLE 



Compute the Line Rate of Linear Image Detection Array (dots/sec) 
based on computed Belt Velocity (inches/sec) and constant Image 
Resolution (dots/inch) desired, using equation: 

Line Rate = (Belt Velocity) x (Image Resolution) 



Compute the Line Rate Compensation factor cosine (6 or 0), where 
6 and 0 is defined in Figs. 18E1 and 18E2, respectively, as the 
computed average scope of the packages surface (i.e laser 
scanned by the AM laser beams powered by the LDIP subsystem) 
and is computed at Block D in Fig. 18A. 



Compute the Compensated Line Rate for the IFD (i.e. camera) 
Subsystem using the equation: 



Compensated Line Rate = (Line Rate) x Cos(0)) 



FIG. 18D 
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Top Down Imaging 



Coplanar PLIB/FOV- 
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AM Laser Beams 




FIG. 18E1 



CASE 2: 
Side Imaging 

Coplanar 



PLIB/FOVX^ ^AM Laser Beams 
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FIG. 18E2 



X Coordinate Subrange Where 
Maximum Range "Intensity" 
Variations Have Been Detected 



Left Right 

Package Package Package 

Edge Height Edge 

(LPE) (h) (RPE) 



Time- 
Package Stamp 
Velocity (nT) 



Row 1 
Row 2 
Row 3 
Row 4 
Row 5 

Row M 



Package Data Buffer (FIFO) 



FIG. 19 



Columns 



Rows 



Camera Pixel Data Buffer 
Pixel Indices (i, j) 



FIG. 20 
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METHOD OF AND APPARATUS FOR PERFORMING AUTOMATIC 
RECOGNITION OF GRAPHICAL INTELLIGENCE CONTAINED IN 2-D 
IMAGES CAPTURED FROM ARBITARY 3-D OBJECT SURFACES 



STEP 1: At the unitary PLIIM-based object imaging and profiling system, 
use the laser doppler imaging and profiling (LDIP) subsystem employed 
therein to (i) consecutively capture a series of linear 3-D surface profile 
maps on a targeted arbitrary (e.g. non-planar or planar) 3-D object 
surface bearing forms of graphical intelligence and (ii) measure the 
velocity of the arbitrary 3-D object surface, wherein the polar coordinates 
of each point in the captured linear 3-D surface profile map are specified 

in a local polar coordinate system ^Dip/polar s y mbo ' ica,, y embedded 
within the LDIP subsystem. 



STEP 2: At the unitary PLIIM-based object imaging and profiling system, 
use coordinate transforms to automatically convert the polar coordinates 
of each point p(a, R) in the captured linear 3-D surface profile map into 
x,y, z Cartesian coordinates specified as p(x,y,z) in a local Cartesian 
coordinate system RLDIP/Cartesiarv symbolically embedded within the LDIP 
subsystem. 



STEP 3: At the unitary PLIIM-based object imaging and profiling system, 
use the PLIIM-based imager employed therein to consecutively capture 
high-resolution linear 2-D images of the arbitrary 3-D object surface 
bearing forms of graphical intelligence (e.g. symbol character strings), 
wherein (i) the x\ y' coordinates of each pixel in each said captured high- 
resolution linear 2-D image is specified in local Cartesian coordinate 
system RpuiM/Cartesian symbolically embedded within the PLIIM-based 
imager, and (ii) the intensity value of the pixel Kx'.y') is associated with the 
x\ y' Cartesian coordinates of the image detection element in the linear 
image detection array at which the pixel is detected, and (iii) wherein also 
the planar laser illumination beam (PLIB) of the PLIIM-based imager is 
spaced from the amplitude modulated (AM) laser scanning beam of the 
LDIP subsystem is about D centimeters. 
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STEP 4: At the unitary PLIIM-based object imaging and profiling system, 
capture and buffer the camera (IFD) parameters used to form and detect 
each linear high-resolution 2-D image captured during the corresponding 

photo-integration time period AT K , by the PLIIM-based imager. 



STEP 5: At the end of each photo-integration time period AT K , use the 
unitary PLIIM-based object imaging and profiling system to transmit the 
following information elements to the Image Processing Computer for 
data storage and subsequent information processing: 

(1) the converted coordinates x, y, z, of each point in the linear 3-D 
surface profile map of the arbitrary 3-D object surface captured during 
photo-integration time period AT K ; 

(2) the measured velocity(ies) of the arbitrary 3-D object surface 
during photo-integration time period AT K ; 

(3) the x\ y' coordinates and intensity value l(x\y') of each pixel in 
each high- resolution linear 2-D image captured during photo-integration 
time period DTk and specified in the local Cartesian coordinate system 

and 

(4) the captured camera (IFD) parameters used to form and detect 
each linear high-resolution 2-D image captured during the photo- 
integration time period AT K 



R PLIIM/Cartesian 



STEP 6: At the Image Processing Computer, receive the data elements 
transmitted from the PLIIM-based profiling and imaging system durin Step 
5, buffer data elements (1) and (2) in a first FIFO buffer memory structure, 
and data elements (3) and (4) in a second FIFO buffer memory structure. 
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STEP 7: At the Image Processing Computer, use the x,y, z coordinates 
associated with a consecutively captured series of linear 3-D surface 
profile maps (i.e. stored in first FIFO memory storage structure)in order to 
construct a 3-D polygon-mesh surface representation of said arbitrary 3-D 
object surface, represented by S LD | P (x.y.z) and having (i) vertices 

specified by x,y, z in local coordinate reference system Rpi_iiM/Cartesian> 
and (ii) planar polygon surface patches s (x,y,z) and being defined by a 
set of said vertices. 



STEP 8: At the Image Processing Computer, convert the x'.y'.z' 
coordinates of each vertex in the 3-D polygon-mesh surface 
representation into the local Cartesian coordinate reference system 

^PLMM/Cartesian symbolically embedded within the PLIIM-based imager. 



STEP 9: At the Image Processing Computer, specify the x'.y', z' 
coordinates of each i-th planar polygon surface patch s(x,y,z) represented 
in the local Cartesian coordinate reference system Rp^iM/cartesian* SO as 
to produce a set of corresponding polygon surface patch {s^x'.y'.z 1 )} 
represented in system R PL |, M/Cartesjan 



STEP 10: At the Image Processing Computer, for a selected linear high- 
resolution 2-D image captured at photo-integration time period AT K , and 
spatially corresponding to one of the linear 3-D surface profile maps 
employed at Step 7, use the camera (IFD) parameters used and recorded 
(i.e. captured) during the corresponding photo-integration time period in 
order to construct a 3-D vector-based "pixel ray" model specifying the 
optical formation of each pixel in the linear 2-D image, wherein a pixel ray 
reflected off a point on the arbitrary 3-D object surface is focused through 
the camera's image formation optics (i.e. configured by the camera 
parameters) and is detected at the pixel's detection element in the linear 
image detection array of the IFD (camera) subsystem. 
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STEP 1 1 : At the Image Processing Computer, for each laser beam ray 
(producing one of the pixels in said selected linear 2-D image), (i) 
determine which polygon surface patch Sj(x, y, z) the pixel ray intersects, 
(ii) compute the x,y, z coordinates of the point of intersection (POI) 
between the pixel ray and the polygon surface patch represented in 
Cartesian coordinate reference system RpLHM/Cartesiarv ancl designate 
the computed set of points of intersecti on as {Pj(x,y,z)}. 



STEP 12: At the Image Processing Computer, for each laser beam ray 
passing through a determined polygon surface patch s(x',y\ z ! ) at a 
computed point of intersection pj(x, y, z), assign the intensity value l(x\y') 
of the pixel ray to the x\ y\ z' coordinates of the point of intersection, 
thereby producing a linear high-resolution 3-D image comprising a 2-D 
array of pixels, each said pixel pixel having as its attributes (i) an Intensity 
value l(x\y\z') and (ii) coordinates x\ y\ z' specified in the local Cartesian 
coordinate reference system Rp LI , M/CartesiarV 



STEP 13: Put the computed linear high-resolution 3-D image in a third ^HVI 
FIFO memory storage structure in the image processing computer. 



STEP 14: Repeat Steps 1-6 to update the first and second FIFO data 
queues maintained in the image processing computer, and Steps 7-13 to 
update the consecutively computed linear high-resolution 3-D image 
stored in the third FIFO memory storage structure. 



STEP 15: Assemble in an image buffer in the image processing 
computer, a set of consecutively computed linear high-resolution 3-D 
images retrieved from the third FIFO data storage device so as to 
construct an "area-type" high-resolution 3-D image of said arbitrary 3-D 
object surface. 
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STEP 16: At the Image Processing Computer, map the intensity value 
l(x\ y\ z') of each pixel in the computed area-type 3-D image onto the 
x\y\z' coordinates of the points on a uniformly-spaced apart "grid" 
positioned perpendicular to the optical axis of the camera subsystem (i.e. 
to model the 2-D planar substrate on which the forms of graphical 
intelligence was originally rendered), wherein said mapping process 
involves using an intensity weighing function based on the x\ y\ z* 
coordinate values of each pixel in the area-type high-resolution 3-D 
image, thereby producing an area-type high-resolution 2-D image of the 
2-D planar substrate surface bearing said forms of graphical intelligence 
(e.g. symbol character strings). 



i 

STEP 17: At the Image Processing Computer, use said OCR algorithm to 
perform automated recognition of graphical intelligence contained in said 
area-type high-resolution 2-D image of said 2-D planar substrate surface 
so as to recognize said graphical intelligence and generate symbolic 
knowledge structures representative thereof. 

STEP 18: Repeat Steps 1-17 as often as required to recognize changes 
in graphical intelligence on the arbitrary moving 3-D object surface. 



FIG. 23C5 
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Specify object detection and tracking capabilities of PLIIM-based network, 
A system, and/or subsystem. 



Specify object identification capabilities of PLIIM-based network , system, and/ 
A or subsystems. 



v 



Specify object attribute acquisition capabilities of PLIIM-based network, 

system, and/or subsystem. 



Determine the configuration of hardware components required to build the 
configured system or network. 



Determine the configuration of software components required to build the 
configured system or network. 



F 



The system configuration manager program accesses the determined software 
components from its Software Library (e.g. maintained on an information server 
within the system engineering department), and compiles these software 
A\ components with all other required software programs, to produce a complete 
System Software Package designed for execution upon a particular operating 
system supported upon the specified hardware configuration. 



The systems configuration manager program automatically generates an easy 
to follow set of Installation Instructions for the configured system or network, 

guiding the technician through an easy to follow installation and set-up 
procedure making sure all of the necessary system and subsystem hardware 
components are properly installed, and the system and network parameters are 
set up for proper system operation and remote servicing. 



H 



Once the hardware components of the system have been properly installed and 
configured, the set up procedure properly completed, the technician is ready to 
operate and test the system for troubles it may experience, and diagnose the 
A\ same with or without remote service assistance made available through the 
remote monitoring, configuring, and servicing system of the present invention, 
illustrated in Figs. 30A through 30D2. 
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Use an Internet-enabled client computer to establish a network 
connection (via network router) with an HTTP server in the tunnel- 
based LAN requiring remote monitoring, control and/or service- 



Use an Internet-enabled client computer to access an RMCS 
management console (GUI) from the HTTP server and display the 

same. 



Use the RMCS management console to display network 
configuration parameters in the tunnel-based LAN, and to use these 
network configuration parameters to monitor configuration 
parameters and performance parameters of each system in the 

network. 



Use the RMCS management console to monitor the configuration 
and other monitorable parameters of each subsystem in the system. 

i 

Use the RMCS management console to run a diagnostic program to 
trouble shoot any performance problems with the system. 



Using information collected by the diagnostic program and the 
RCMS management console, reconfigure selected parameters in 
the system and instruct any hardware repairs that may be required 

at the LAN location. 

s 



FIG. 30D1 



f 

Use the RMCS management console to rerun diagnostic programs 
on troubled systems and subsystems in the LAN after parameter 
reconfiguration and/or hardware repair at the LAN location, so as to 
test the performance of such systems and subsystems and the 
overall tunnel based LAN. 



Use the RMCS management console to monitor parameters of the 
system and subsystems in the tunnel based LAN, from time to time, 
to determine whether or not the system 
and/or network tunnel require servicing. 



Use the RMCS management console to record all monitored 
parameter records and result of diagnostic programs in a customer 
service database for future reference, and access during 
subsequent remote service calls over the Internet. 



FIG. 30D2 
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FIG. 31A 



For each package transported through tunnel system, the master unit (with 
package dimensioning subsystem and velocity detection subsystem) generates 

package height, width, length and velocity data (H, W, L, V) G , referenced with 

respect to global coordinate reference system Rqiq^qi an d transmits such j 
A package dimension data to each slave unit downstream, using the systems 
data communication network. 



Each slave unit receives the transmitted package height, width, and length 
data {H, W, L,V} G and converts this coordinate information into the slave unit's 
local coordinate reference system R Loca | (> {H, W. L, V}. 



I 



The camera control computer in each slave unit uses the converted package 
height, width, length data {H ( W, L}j and package velocity data to generate 
camera control signals for driving the camera subsystem in the slave unit to 
zoom and focus in on the transported package as it moves by the slave unit, 
while ensuring that captured images having substantially constant O.P.I. 
Resolution and 1:1 aspect ratio. 



FIG. 32A 
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E 




Each slave unit captures images acquired by its intelligently controlled camera 
subsystem, buffers the same, and processes the images to decode bar code 
A symbol identifiers represented in said images, and/ or to perform optical 
D character recognition (OCR) thereupon. 



I 



The slave unit which decodes a bar code symbol in a processed image 
automatically transmits a package identification data element (containing 
symbol character data representative of the decoded bar code symbol) to the 
master unit (or other designated system control unit employing data element 
management functionalities) for package data element processing. 



A 

F 



I 



Master unit time-stamps received package identification data element, places 
said data element in a data queue, and processes package identification data 
elements and time-stamped package dimension data elements in said queue 
to link each package identification data element with one said corresponding 
package dimension data element. 
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Each passenger who is about to board an aircraft at an airport, would first go to 
check-in station with personal identification (e.g. passport, drivers license, national 
identification card, etc.) in hand, as well as with articles of baggage to be carried on 
board by the passenger. 



Upon checking in with this station, the Passenger Identification (PID) Bar Code 
Symbol And Baggage Identification (BID) Bar Code Symbol Dispensing Subsystem 
issues (1) a passenger identification bracelet bearing (or otherwise encoded with) a 
PID bar code symbol, and (2) a corresponding PID bar code symbol for attachment 
to each package carried on the aircraft by the passenger. At the same time, this 
subsystem creates, for each passenger and set of baggage checked into the 
system at the check-in station, a passenger/baggage information record in the 
Passenger and Baggage Attribute RDBMS. 



The passenger identification (PID) bracelet (or identification badge) is affixed to the 
passenger s person at the passenger check-in station which is to be worn during the 
entire duration of the passenger 1 s scheduled flight. 



The PLIIM-Based Passenger Identification And Profiling Camera Subsystem at the 
passenger check-in automatically captures (i) a digital image of the passenger s 
face, head and upper body, (ii) a digital profile of his or her face and head (and 
possibly body) using the LDIP subsystem employed therein, and (iii) a digital image 
of the passenger s identification card(s). Other biometric information acquisition 
devices provided at the passenger check-in station can be used to aquire from each 
passenger checking-in, passenger attribute information (e.g. retinal pattern 
information, fingerprint pattern information, voice pattern information, facial pattern 
information, DNA pattern information) to assist in the reliable identification of the 
passenger. 



Each item of passenger attribute information acquired at the passenger check-in 
station is co-indexed with the corresponding passenger identification (PID) number, 
and stored in the information records maintained in the Passenger and Baggage 
Attribute RDBMS, subsequent information processing. 



FIG. 68D1 



Each BID bar coded article of baggage is conveyed through the tunnel-type 
package identification, dimensioning and tracking subsystem installed before the 
entry port of the X-radiation baggage scanning subsystem (or integrated there 
within), and is then conveyed through the X-radiation baggage scanning subsystem. 
As this scanning process occurs, each bar coded article of baggage is automatically 
identified, imaged, and dimensioned/ profiled by package identification, 
dimensioning and tracking subsystem and then imaged by x-radiation scanning 
subsystem. 



Each item of baggage attribute information acquired at the baggage check-in station 
is co-indexed with the corresponding baggage identification (BID) number, and 
stored in the information records maintained in the Passenger and Baggage 
Attribute RDBMS, subsequent information processing. 



Each BID bar coded article of baggage is conveyed through a second tunnel-type 
package identification, dimensioning and tracking subsystem installed downstream, 
before the entry port of the automated explosive detection subsystem EDS (or 
integrated there within), and is conveyed through the EDS. 



I 

At the EDS station, each bar coded article of baggage is automatically identified, 
imaged, and dimensioned/ profiled by package identification, dimensioning and 
tracking subsystem and then analyzed by EDS. 

Each item of baggage attribute information acquired at the EDS station is co- 
indexed with the corresponding baggage identification (BID) number, and stored in 
the information records maintained in the Passenger and Baggage Attribute 
RDBMS, subsequent information processing. 



FIG. 68D2 




Conventional methods of detecting suspicious conditions revealed by x-ray images 
of baggage can be used (e.g. using an x-ray image monitor adjacent the x-ray 
£ scanning subsystem). 



Intelligent information processing algorithms can be used to automatically operate 
on each passenger and baggage attribute record stored in the Passenger and 
Baggage Attribute RDBMS. 



Passenger attribute information stored in remote intelligence RDBMS can be 
accessed and used with passenger and baggage attribute information in the 
a Passenger and Baggage Attribute RDBMS in order to detect any suspicious 
M conditions which may be given concern or alarm about either a particular passenger 
or article of baggage presenting concern or breach of security. 



Such post-check-in information processing operations can also be carried out on 
passenger and/ or baggage attribute information stored in the Passenger and 
Attribute RDBMS and/ or remote intelligence RDBMS on a wide area network 
N (WAN) or local area network (LAN) with human assistance, if necessary, to 
determine if a breach of security appears to have occurred. 



i 



If a breach is determined prior to flight-time, then the flight related to the suspect 
passenger and/ or baggage might be aborted with the use of security personnel 
signaled by subsystem. If a breach is detected after an aircraft has lifted off, then 
q the flight crew and pilot can be informed by radio communication of the detected 
security concern. 



FIG. 68D3 



Each passenger who is about to board an aircraft at an airport, would first go to 
check-in station with personal identification (e.g. passport, drivers license, national 
identification card, etc.) in hand, as well as with articles of baggage to be carried on 
board by the passenger. 



Upon checking in with this station, the Passenger Identification (PID) Bar Code . 
Symbol And Baggage Identification (BID) Bar Code Symbol Dispensing Subsystem 
issues (1) a passenger identification bracelet bearing (or otherwise encoded with) a 
PID bar code symbol, and (2) a corresponding PID bar code symbol for attachment 
to each package carried on the aircraft by the passenger. At the same time, this 
subsystem creates, for each passenger and set of baggage checked into the 
system at the check-in station, a passenger/baggage information record in the 
Passenger and Baggage Attribute RDBMS. 



The passenger identification (PID) bracelet (or identification badge) is affixed to the 
passenger s person at the passenger check-in station which is to be worn during the 
entire duration of the passenger 1 s scheduled flight. 



The PLIIM-Based Passenger Identification And Profiling Camera Subsystem at the 
passenger check-in automatically captures (i) a digital image of the passenger s 
face, head and upper body, (ii) a digital profile of his or her face and head (and 
possibly body) using the LDIP subsystem employed therein, and (iii) a digital image 
of the passenger s identification card(s). Other biometric information acquisition 
devices provided at the passenger check-in station can be used to aquire from each 
passenger checking-in, passenger attribute information (e.g. retinal pattern 
information, fingerprint pattern information, voice pattern information, facial pattern 
information, DNA pattern information) to assist in the reliable identification of the 
passenger. 



I 

Each item of passenger attribute information acquired at the passenger check-in 
station is co-indexed with the corresponding passenger identification (PID) number, 
and stored in the information records maintained in the Passenger and Baggage 
Attribute RDBMS, subsequent information processing. 
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Each BID bar coded article of baggage is conveyed through the tunnel-type 
package identification, dimensioning and tracking subsystem installed before the 
entry port of the X-radiation baggage scanning subsystem (or integrated there 
within), and is then conveyed through the X-radiation baggage scanning subsystem. 
As this scanning process occurs, each bar coded article of baggage is automatically 
identified, imaged, and dimensioned/ profiled by package identification, 
dimensioning and tracking subsystem and then imaged by x-radiation scanning 
subsystem. 



Each item of baggage attribute information acquired at the baggage check-in station 
is co-indexed with the corresponding baggage identification (BID) number, and 
/ \ stored in the information records maintained in the Passenger and Baggage 
Attribute RDBMS, subsequent information processing. 



Each BID bar coded article of baggage is conveyed through a second tunnel-type 
package identification, dimensioning and tracking subsystem installed downstream, 
before the entry port of the automated explosive detection subsystem EDS (or 
integrated there within), and is conveyed through the EDS. 



At the EDS station, each bar coded article of baggage is automatically identified, 
imaged, and dimensioned/ profiled by package identification, dimensioning and 
tracking subsystem and then analyzed by EDS. 



Each item of baggage attribute information acquired at the EDS station is co- 
indexed with the corresponding baggage identification (BID) number, and stored in 
the information records maintained in the Passenger and Baggage Attribute 
RDBMS, subsequent information processing. 
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Conventional methods of detecting suspicious conditions revealed by x-ray images 
of baggage can be used (e.g. using an x-ray image monitor adjacent the x-ray 
scanning subsystem). 



Intelligent information processing algorithms can be used to automatically operate 
a on each passenger and baggage attribute record stored in the Passenger and 
Baggage Attribute RDBMS. 
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Passenger attribute information stored in remote intelligence RDBMS can be 
accessed and used with passenger and baggage attribute information in the 
Passenger and Baggage Attribute RDBMS in order to detect any suspicious 
conditions which may be given concern or alarm about either a particular passenger 
or article of baggage presenting concern or breach of security. 



Such post-check-in information processing operations can also be carried out on 
passenger and/ or baggage attribute information stored in the Passenger and 
Attribute RDBMS and/ or remote intelligence RDBMS on a wide area network 
fs| (WAN) or local area network (LAN) with human assistance, if necessary, to 
determine if a breach of security appears to have occurred. 
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If a breach is determined prior to flight-time, then the flight related to the suspect 
passenger and/ or baggage might be aborted with the use of security personnel 
signaled by subsystem. If a breach is detected after an aircraft has lifted off, then 
the flight crew and pilot can be informed by radio communication of the detected 
security concern. 
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